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Abstract 



An example of a discrete-time stationary random process whose 
sums follow the normal approximation within a given part of the region 
of moderate deviations, but violate it outside this part. 
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Introduction 

In the simplest classical case of sums S n = Xi + - ■ -+X n of bounded i.i.d. ran- 
dom variables Xj, with mean and variance 1, CLT (Central limit theorem) 
states the normal approximation 

( S \ f°° 1 2 

P ( — % > u ) -»■ / ^=e~* 2/2 dt asn^oo; 



n J J u V27T 

MDP (moderate deviations principle) extends the normal approximation to 
larger it, 



(2) InP ( —= > u n J ~ — u as n — > oo 

<n ) 2 



whenever u n — > oo and n 1 ' 2 u n — > ("~" means that the ratio converges to 
1); and LDP (large deviations principle) treats even larger u, 



(3) In P ( — !L > ay/n ] ~ —nl(a) as n — > oo , 
where the rate function /(•) satisfies 

(4) 1(a) ~ ^a 2 as a -)• . 

It may be tempting to deduce ([2]) from ([3]) and (jl]) by taking a n y/n = u 
however, ()3]) does not claim uniformity in a (for small a). Under some addi- 
tional assumptions, MDP can indeed be deduced from LDP, see [21 Th. 1.2]. 

We consider a discrete-time stationary random process (X^)fc. That is, 
(Xk need not be independent, and) for every n the joint distribution of 
X m , . . . , X m+n does not depend on m. 

Numerous works prove LDP and/or MDP under various conditions on 
(Xfe)fc. Still, in general, relations between LDP and MDP, as well as between 
MDP for different sequences (u n ) n , are poorly understood. 

Theorem 1. Assume that an open set Gq C (0, l/2) ; bounded away from 0, 
consist of a finite number of intervals, and G\ is the interior of the comple- 
ment (0,1/2) \ Gq. Then there exists a stationary process (Xk)k such that 
for all 7 G G U Gi and c G (0, oo), 

n^n 2 ^ V V™ J \0 ifieG . 

In addition, the process (Xk)k constructed in the proof of Theorem [1] 
satisfies ([3]), (j4j). Also, the distribution of Xi (and every X k ) is bounded 
and symmetric, that is, P(|Xi| < C) = 1 for some C, and F(X 1 < x) = 
¥(-Xx < x) for all x. Also, E (XiX n ) = 0(exp(-n e )) (as n ^ oo) for 
some e > 0. 



(1 ! 
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1 Constructing a process 

We start with a very simple Markov chain well-known in the renewal theory. 
Its state space is the countable set {(0,0)} U ({1,2,3,...} x {1,2,3,...}). 



The transition probability from (0,0) to (l,n — 1) is equal to p n for n = 
2, 3, ... ; and p\ = 1 — p 2 — ps — . . . is the transition probability from (0, 0) to 
itself. For k > 0, 1 > the only possible transition from (k, I) is to (k+1, 1 — I) 
if I > 1, otherwise to (0,0). Thus, the motion consists of excursions of the 
form (0, 0) H> (1, n - 1) H> (2, n - 2) ^ . . . H> (n - 1, 1) ^ (0, 0) (for n > 1) 
or just (0, 0) >-> (0, 0) (for n = 1). 

An invariant probability measure (if exists) must give equal probabilities 
/!„ to all points (k, I) with k + I = n; here n G {0} U {2, 3, 4, . . . }. Such ji is 
invariant if and only if 

(1.1) HoPn = Hn for ra = 2,3,4,... 

(the equality fi^pi + yU 2 + 7/3 + • • • = /xo follows). And, of course, /io + ^2 + 
2/i 3 + 3/i4 + ••• = !, that is, /xq(1 + £>2 + 2p 3 + ...) = 1 or, equivalently, 



Clearly, /x exists if and only if p\ + 2p 2 + 3p3 + • • • < 00 (finite mean renewal 
time); and /x is unique. 

We restrict ourselves to the steady-state Markov chain; that is, the in- 
variant probability measure /x exists, and the state is distributed /x at every 
instant. Denoting by (A t , B t ) the state of the Markov chain at t we get a 
two-dimensional random process (A t , B t )t&, both stationary and Markovian. 
The random set {t : (A t , B t ) = (0, 0)} is well-known as a stationary renewal 
process; its points are called renewal times. Accordingly, A t is called the 
age (or backwards recurrence time) at t, and B t — the residual life time 
(or forward recurrence time) at t. Note that t — A t is the last renewal time 
on (— 00, t], and t + B t — the first renewal time on [t, 00). The duration 




Ho(pi + 2p 2 + 3p 3 + ...) = I. 
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(t + B t ) — {t — A t ) = A t + B t of an excursion (unless t is a renewal time) is 
called a renewal interval. 



0) IP 

J B 




t-A t t t+B t 
renewal interval » 



Large and moderate deviations will be examined for the stationary process 

(1.2) Xt = ±<p(A t ,B t ) loiteZ 

where a random sign "±" is chosen once for each excursion, and ip is a 
real-valued function on the state space of the Markov chain. More formally, 
we may take X t = S t -A t p(A t , B t ) where (S t )t& is a family of mutually 
independent random signs (—1 or +1 equiprobably) , independent of (A t , B t ) t . 
It remains to specify the numbers p n , or equivalently and the function (p. 
Given two parameters a, (3 satisfying 

(1.3) ct>0, 0>O, a + 2/3<i, 
we define the measure \x by 

(1.4) n/i n+ i + (n + l)/i n+2 H = exp(-n a ) for n = 1, 2, . . . 

and the function ip by 

Uk + iy? if e<k + i, 

(1-5) <p{k,l) = < . 

I U otherwise 

for k, I > 0; and p{0, 0) = 0. 

1.6 Theorem. There exists a G (0, oo) such that the process {o~~ 1 X t ) t& % 
satisfies Theorem^ for 

Go = (u, v) , G\ = (0, u) U (v, 0.5) , where 

(1.7) u = - -, v = --2(3. 

K J 2(1 -a- 2/3)' 2 ^ 

Remark: by (|L3i) . 0<w<a<i;< 0.5. 

Remark: arbitrary w,f satisfying < u < v < 0.5 are of the form (\1.7\i 
for some a, (3 satisfying fll.3p . Proof: take j3 = 0.25(1 — 2v) and a = j¥^u, 
then 0.5 - a - 2(3 = > 0. 



2 Examining the process 



The sum 

S n — X\ + • • ■ + X n 

may be treated as the sum over excursions (from the origin to the origin) of 
the process (A t ,B t ) t ; no ambiguity appears, since ip(Q, 0) = 0. 

We introduce S n = X 1+Bl + - • -+X n _ An (the sum over complete excursions 
within [l,n]), S' n = X x + • • • + X x+Bl and = X n _ An + ■ • • + X n (the 
contributions of the two incomplete excursions). 




It may happen that (A t ,B t ) = (0,0) only once on [l,n]; then S n = 0. It 
may also happen that (A t ,B t ) ^ (0,0) for all t G [l,n]; in this case we take 
S' n = 0, S n = 0, S" = S n . In every case, 



(2.1) 



Conditionally, given (A k , B k ) k , the summands S' n , S n , S" are independent and 
symmetrically distributed (due to the "±" in ( II. 2p ). thus, for every c, 

(2.2) F(S n >c) > ~max(F(S' n + S';>c),F(S n ) > c) 

It appears that S n satisfy MDP for all 7 (Lemma 12.31) . while S' n + S 1 " is too 
large for 7 G (u, v) but small for 7 G (0, u) U (v, 0.5) (Lemma 12. 4ft . 

2.3 Lemma. There exists a G (0, 00) such that 
lnP^ §n N 1 



> w n ~ — m„ as n — >■ 00 
oyn / 2 

whenever u n — )■ 00 and n~ 1 / 2 u n — > 0. 

2.4 Lemma. For a// 7 G (0, -a) U (-a, U (t> , 0.5) and all c > 0, 



1 



n— too fi 



20 



lim -^lnPl ^ > cn 7 



-00 j/7 6 (0,u)U (v, 0.5), 

if~fe(u,v). 
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We first deduce Theorem 11.61 from these lemmas proved afterwards. 
Proof of Theorem \l.b\ For 7 G {u,v) we have by (12. 2p and Lemma [2.41 



liminf 4" lnP( ^= > cnA > liminf -^lnP( Sn > cn 7 ) = 

n^oo rr 7 \ / n->-oo n 27 \ Jn 



Let 7 G (0, w) U (f , 0.5) and c > 0. On one hand, by (12. 2p (again) and Lemma 
lim inf — — In P ( > cn 1 | > lim inf — — In P ( > cn 7 | = — c 2 . 



n->oo n 27 \0~^/n J n->oo n 27 \ O \/n I 2 

On the other hand, for every e > 0, 

pf >cnA <r(-^> (c-e)nA +f( S ' n > en 7 
V o~ \l ti I \ oJn I \ aJn 



for n large enough we have 

P^-^ > (c-e)n^ < exp (n 27 (-0.5(c - e) 2 + e) 

by Lemma [2731 a similar (and even much stronger) bound for P ( > en 7 ) 

holds by Lemma 12. 4j thus, 

for all £ > 0. □ 

The process (5 , n )n=i,2,... is a so-called renewal-reward process; it jumps at 
renewal times, and each jump size depends only on the corresponding (just 
finished) renewal interval. This process is delayed (that is, not necessarily 
starts at a renewal time); a time-shifted process (Si + B 1 +n)n=a,i,... is an ordi- 
nary (that is, not delayed) renewal-reward process. MDP for such processes 
are available [1] under the conditions 

(2.5) Er<oo, 

(2.6) E exp(eX 2 — r) < 00 for some e > ; 

here r is a renewal interval, and X is the corresponding jump size. (The 
renewal-reward process is formed by a sequence of independent copies of the 
pair (r, X).) 

Here is a result for ordinary renewal-reward processes (5 , (t)) ig [ 0)O o), for- 
mulated in pQ only for EX 2 = 1, Er = 1; the general case follows easily by 
rescaling. 
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2.7 Theorem. ([]])// d23D, (ESD are satisfied andEX — 0, EX 2 ^ tfien 
EX 2 < oo and 

lim ^lnP((j- 1 5(t) > xv^) = -- 



'EI 2 

Lattice and nonlattice cases are both covered by Theorem 12.7} but we 
need only the lattice case: r£ {1,2,...} a.s.; then 

(2.8) lnPfa-^H > u n Vrl) ~ ~u 2 n 

whenever u n — > oo and n~ l l 2 u n — > 0. The transition from ordinary to delayed 
process is made as follows. 

2.9 Lemma. Let random variables S(n) satisfy (12. 8ft . and for alln, S(n) < n 
a.s. Let T be a random variable independent of (S(n)) n , T e {0, 1, 2, ... } 
a.s. Then (12.81) holds also for the random variables 

(S(n-T) forn>T, 
I otherwise. 

Proof. For every e > 0, for all n > n e , 

exp ( - -y^ M n) < P(CT _1 S(n) > u n y/n) < exp ( - — «n) • 

We choose t such that P(T = t) >0 and get 

¥(a- 1 S , (n) > « n Vn) > P(T = t)P (^^(n - t) > u nV ^) > 

> P(r = t) exp(-l±£^) 

for all n > n £ + 1, thus, 

lim sup (^lnP(a" 1 ,S / (n) > m,^)) < 1 + e 
for all £ > 0. On the other hand, 

n 

F(a~ 1 S'(n) >u n Vn) = ^P(T = k)F (a~ 1 S(n — k) > u n yfn) ] 

k=0 
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for n large enough we have au n y/n > n £ , thus, k < n—n £ (otherwise a~ 1 S(n— 
k) cannot exceed u n y/n, since S(n — k) < n — k a.s.), therefore F^a^S'in) > 
u n y/n) < maxfc P (a~ 1 S(n — k) > u n y/n) < exp(— ^-^u^j and 

liminf f^lnP(o-~ 1 S"(n) > u nV ^)) > 1 - e 

for all e > 0. □ 
In our situation 

(2.10) p( r = A;)=p fc for k = 1,2,... 

(for p fc see ( II. ip ) and roughly 



(2.11) X^±^- 



r 



-0 



(recall (jl.2p and (II. 5p ); in order to make it exact, yjr should be replaced 
with its integral part, but this small correction is left to the reader. 

Proof of Lemma \2. Si . By ( II ,4p . ln/x n ~ — n a \ by (II. ip . lnp n ~ — n a ; by 
dSHOj), (EU) and (OD we see that Er < oo, EX = 0, EX 2 ^ 0, and fj2TH]l 
is satisfied (with e = 1). Thus, Theorem 12 . 71 gives MDP for (Si+B 1 +n)n=o,i,...i 
and Lemma 1231 gives (12. 8p for (5 , n )n=i,2,...- D 



Proof of Lemma\2.4\ By (11.41) . 



(2.12) \nF (A t + B 1 > k) = InF (A n + B n > k) = -k a for A; = 1,2,... 
Similarly to (I2~TT|) . 

(2,3, ±( .4 1 + Bl )^J(^^-^ + 

I U otherwise; 

(2.14) ±(A n + S n )^« 

w ^min(ra, n — A n + + -B„ ) — max(l, n — A n + 1) + l^j = 

= (min(A n , ^/A~fK) -(A n -n)+) + ; 

here x + = max(i, 0). Note that 



(2.15) \S' n \ < (A 1 + B 1 ) - 5 ^ , \S';\ < (An + B. 



0.5-/3 

n ) 
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Let 7 G (0, u) U (u, v) U (v, 0.5) and c> be given. (Recall (ILTjU 
Case 1: 7 e (0, u). 

We have 7 < 2 (i-a-2S) > ^ na ^ o~5-,8 a > ^ Taking into account that 



2(l-a-2/3) ' 



n 



>cnA <F(S' n > 0.5cn 7+0 ' 5 ) +W(S'J l > 0.5cn 7+0 - 5 ) < 



< P((Ai + J B 1 ) a5 ~ /3 > 0.5cn 7+a5 ) +P((A„ + J B n ) a5 ^ > 0.5cn 7+a5 ) 
we get 

1 . -/ ^ + ^ -A In 2 1 /hm 



InP - — n > en 1 < — — • const - n 0.5-/3 ->■ -00 

n 2 ^ \ Jn J ~ n 2, y n 2 ^ 



Case 2: 7 G (w, «]. 

We have 7 > 2 (i-a-2/3) ; that is, 05-'^ < 17- For l ar g e n i we choose 
c n G {1, 2, . . . } such that 

7+0-5 2j_ 

72,0.5-/3 <c„Cn° , 

note that -yjc^ <C n 7//a < n, and choose a n , 6 n G {1,2,...} such that a n + b n = 
c n and 

\A„ + b n < a n <n. 
Taking into account that In /i n ~ — n a we have 

lnP(A„ = a n ,B n = b n ) = \n^ an+bn ~ -(a n + b n ) a . 

Conditionally, given A n = a n and B n = b n we have by (12.141) 

% « ±(a n + b n f^ ; |^| « c°- 5 ^ » n 7+a5 . 

Also, and are conditionally independent, since [l,n] contains (at least 
one) renewal time n — a n . Thus, for large n, 

P f5±S > cn 7 ) > ip(S;; > cn 7+0 - 5 ) > -¥{A n = a n ,B n = b n ) , 

and we get 

Case 3: 7 G [a, u). 
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The proof of Case 2 needs only the following modifications. In the start: 
we have 7 < 0.5 — 2/3, that is, ^X-p < ^' anc ^ we ^ a ^ e 

7+0.5 „ 

n 0.5-/3 < c „ « n . 

In the end: c" <C n 2a < n 27 . 
Case 4: 7 G (u,0.5). 

Combining (12.15P with trivial inequalities \S' n \ < n(A\ + Bi)~P, \S"\ < 
n(A n + S n )- /3 we get 

\S' n \ < {A 1 +B 1 )^vain{n, jA 1 +B 1 ) , \S'^\ < (A n +B n )^ mm(n, V ' A n + B n ) . 

We note that generally 

min(n, \/x) < n 1 ^ 213 for all x G (0, 00) 

(indeed, the function x 1— >■ x~^min(n, y'x) is increasing on (0,n 2 ] since /3 < 
0.5, and decreasing on [n 2 , 00) since (3 > 0). 

Thus, 1 < n 1_2/3 , 1 5*" I < n 1-2 ^ a.s., and we get for large n 

'n / 



since 0.5 — 2(3 = v < 7. □ 



3 Combining such processes 

Given < U\ < v\ < u 2 < v 2 < 0.5, we construct two independent processes 
(Xj^)t, (X^) t as in Sect. [Q, the former satisfying Theorem [1] for G = 
(ui,Vi), the latter — for G = {u 2l v 2 ). Then their sum 

being normalized (divided by a), satisfies Theorem [1] for G = (ui,Vi) U 
{u 2 ,v 2 ). 

Proof. Case 1: 7 G (0,Wi) U (t>i,u 2 ) U (v 2 ,0.5). 
By Theorem II. 6[ both processes 



-in(>) _ x i ^ r~ ^« 



(for i = 1,2) satisfy LDP with speed {n 2/y ) n and rate function c 1— > 0.5c 2 . By 
independence, the two-dimensional process (erf 1 Sn\ o- 2 1 Sn* > )n satisfies LDP 
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with speed {n 2 " f ) n and rate function (ci, c 2 ) H- 0.5(cf +c|). By the contraction 
principle, the linear combination (a~ 1 S n ) n (where S n = S$p + Sn an d a = 
\/ a\ J r o\ ) satisfies LDP with speed {n 2l ) n and rate function c \-¥ 0.5c 2 . 
Case 2: 7 G (ui, v i). 

The argument is the same, but now the first rate function is identically 
zero, thus, the two-dimensional rate function is (c\,C2) 0.5c?,, and the 
contraction principle returns identically zero. 

Case 3: 7 G (u 2 , v 2 ). 

Similar to Case 2. □ 

A finite number of independent processes can be combined similarly, 
which completes the proof of Theorem [TJ 
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